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, deqreés is, identified as a crucial issue in outcome-oriented 8 
. ‘ educational programs. Attainment is contrasted with competence as a 
basis on which to award college degrees in teras of their respective 
characteristics, assessment practices, and accountability for 
standards. A case is made that. attainment, the educable enabler of 
t competence, is ‘preferred to competence itself as the basis on which 

to certify learning outcomes of educational programs. (Author/LBH) 


Pa 


“ 


‘ 


*“* eeeseeoennedesetecisaeeseessanns SEEEREREKE ES HEREEREEEREREEER EEE SHEERS 


* Documents acquired by ERIC include many informal unpublished * 

* aatediala not available from other sources. ERIC makes every effort * 

* to obtain the. best copy available. Nevertheless, items of marginal * 

* reproducibility are often encountered and this affects the quality * \ 
* of the microfiche and, hardcopy reproductions ERIC makes available * \s 
* via the ERIC Document Reproduction Service (EDRS). EDRS is not » * 

* responsible for the quality of the original document. Reproductions * 
* supplied by EDRS are the best Ahat can be made from the original. * 
EREKERERERE ERE REREEERE EE REE EEEE EER EEE SEER EEEEE EERE REEEEEEEEEERERE EERE EE 


- 


d 


- 


Attainment Rather Thah Competence: 


oO. 
Oo 
nt 
Ln 
= 
<i: 
am) 
Lu 


A Legitimate Basis for the 
Certification of Learning Nytcomes 


Gary W. Peterson 


ABSTRACT 


Little attention has been devoted to determining the nature 
-of certifiable learning outcomes in atiteoneortented educational 
sHearati, To date, these programs have generally been concerned 
with the identification of learning outcones, gna to a lesser 
extent, with assessment, per se; but they have not yet grappled 
witht the certification of learning outcomes reguihpad for de- 
grees. Attainment is .contrasted with competence as a basis 
upon which to xiand college. degrees. in terms of their respective 
characteristics, assessment practices, and accountability for 
Risndshas: rere is made that attainment, the adcable enabler *° 
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of competence, is preferred, to competence itself as the basis upon . 
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which to certify learning outcomes of educational programs. 
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Attainment Rather Than dompetence: 
ag Te oh Legitimate Basis for the 
Certification of Learning Outcomes. 
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| Gary W. Peterson 


Outcone-oriented education may be perceived as a solution for address- 
ing society's needs for open access, equal opportunity and flexibility in’: 
post secondary education while at the same time maintaining credibility of 
aeavepnie standards. One of the host important implications ‘of outcome- 
orierted education (Whether it‘is called’ competency-based education or 
performance-based education) is that individuals may one day earn college 
degrees solely on the basis of the demonstration of knowledge. or skills 
without having Ponen a single college course, And if, with the steady 
growth of outcome- oriented educational programs , educational institutions 
continue toward the eventual awardjng of degrees based exclusively on . 
public’ performances with explicit standards ; the precise delineation of 
certifiable behaviors and their cognitive, psychomotor and affective com- 
ponents .should be of serious concern both to edisutete and the public. 
Consequently, the distinction js made between competence and attainment 
to more clearly describe the kinds of behavior that may be assessed and 
certified for the atalning ot college degrees. The point of view taken 
is tnat aEeRrOneNey rather than competence, is the more realistic and 

legitimate basis upon Witten to award degrees where the principal require- 
ment is the denanetration’ of specified scholarly jor Professional knowledge 
anh sents? ‘Ts 4.7% i. 


" The term "attainment" was used by. Harris! in contrast to "exposures" 


————, 
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as a basis upon which bacéalaureate degrees should be awarded. Giardinaé 


suggested the concept of "achievement" as a criterion for the ‘awarding of 
the. baccalaureate. Knott? described a competence-based curriculum as 
niin explicit ‘educational Outcomes and well-defined learning experiences 
to "achieve them. These authors , however, did not describe the characteris- 
tics of attainment, achievement, or competence as they related to assessment 
practices, validation, of standards, or plausible procedures for certifying 
learning outcomes . 


Toward this end, competence is contrasted with attainment to the kinds* 


of pehavfors that can be certified for the awarding of degrees. In this 


essay, competence is defined as the demons tration of a composite set of 
skills, knowledge, attitudes ,- and. personNity characteristics in real- 
life settings. that are required to successfully perform designated socie- 


tal roles. . Attainment, on the other hand, refers to the specific demon- 
pee Dee 


strations of skills or knowledge in’an academic setting which reflect the 


desired learning outcomes of educational programs. The latter is, therefore, 


preferred to competence when characterizing certifiable learning outcomes 


since realistically it is doubtful whether educational institutions can 
either measure or even foster competence within the framework of existing 


educational programs. 


einenee of Competence and Attainment 
The attributes and requirements of competence and attainment are pre- 
sented in Table 1 to provide a background for the Subsequent discussion of 
their. RESPRESINE assessment practices and procedures for certification. 
\ 


For purposes of this paper, certification in post secondary education is 


the act of verifying, that an individual has fulfilled the requirements 


/ 


for a degree or certificate by a legitimate authority. 


( 


(INSERT TABLE 1 HERE) 


Summarizing fromthe table, competence is described as holistic, athe 
Ject to idiosyncratic integration of its elements, generalizable and trans- 
ferable among real-life contexts, possibly insensitive to educational inter- 
vention, and predicative of subsequent’ effective performance. Attainment, 
on the other hand, is characterized by minimum performance standards , not . 
{mmedtately: clatwing generalizability, sensitivity to educational. inter- 
vention, and concurrent validity. These ‘differences become extremely im- 
portant in deriving their respective methodologies for assessment, 


The Assessment of Com etence and Attainment 


In creer to éapture the holistic nature of CONBETENCE:, indi viduals : 
should be observed in the process of effectively intégrgging its elements 
under A Brey of conditions, in actual occupational or societal settings 

over a period of time. As Stresse y Bronfenbrenner4, skills, knowledge 
- or attitudes acquired in an ae nae can be evaluated adequately 
only if they are subsequently observed in nanceeadenie environments . For 
example, if a physician candidate wishes to be certified competent in per- 
forming certain surgical procedures, he/she should perform these procedures 


in the field under a variety of conditions (intern), and be observed by a 


number of competent practitioners. All failures and errors are recorded to 


provide an indication of potential for unjustified risk or errors in self- 
judgment. Furthermore, criteria for certification should include not only 


o~) BS 
the demonstration of the specific surgical skills, but other intrinsic 


7 ay 
, Table 1. Attributes of Competence and Attainment * = ’ 
; aig 
Dimens{on COMPETENCE “. ATTAINMENT =. 
° 1. Holistic vs. elemental Competence is holistic re- Attainment is elemental 


2. Uniform vs. 
idiosyncratic stan- 
dards of perrere 

‘ mance 


; = \ 


3. Susceptibility to 
educational intervention 


4. Validity of measures 


ee 


2 


5. Legitimate statements 


~ highly questionable. 


’ cational intervention. 
“all individuals are suited 


qui rug the integration of 
a complex set of skills, 
knowledge, and attitudes, 
both explicit and- implicit 
«to effectively meet occupa- 


tional and societal demands. - 


Performance standards for 
the elements of competence 
are idiosyncratic such that . 
some highly developed at- 

tributes compensate for 
lesser developed. ones ren- 
dering the, establishing of 
minimum standards for them 


Aspects of competence may~ 
not be susceptible to edu-- 
Not 


for afl] occupations or 
walks of life. Innate cog- 
‘nitive, psychomotor abili- 
ties, or personality proy 
clivities, or the ways in 
which these attributes are 
integrated, may’ preclude an 
individual from even be- 
coming competent regard- 
less of the amount or 
nature of education. 


Competence transcends time 
and environmental contexts. 
A competent individual is 


‘ able to demonstrate compe- 


tence in a wide variety of 
real-life situations over 
an extended period of time. 
Hence, measures of compe- 
tence are predictive of sub- 
sequent performance. 


Since competence -is predic- 
tive, statements are couched 
‘in the future tense, e.g. an 
individual will be able to.. 
perform certain Surgical pro- 
cedures, conduct tax audits, 
facilitate therapeutic en- 
counters, parent children, 
etc. 


«ing achievement beyond 
-able. 


“tion and are analyzed 


‘of mastery by virtually = ee 


“Attainment is not claim- 


dering, etc. 


consisting-of clearly de-" 
fined sets of knowledge 
and skills; with explicit 
performan e Standards. 


Attainment, ipso facto, 

connotes minimum stand- 

ards of peyoceatte for. 4 
all knowledge and skill . ' 
areas required for degrees. , : 
Recognition of outstand- \. a 


the minimum is’ desir- - 


Attainments required ‘ 
for degrees are subject 
to educational interven- 


in terms of specific ° 
learning sequences, from 

simple to complex be- 

haviors.. Presumably, 

attainments are capable 


all individuals (exclud- 
ing those with obvious 
behavioral disorders) if 
aye enoggh time. 


ed to be generalizable ' 
(although hopefully it 
is). All that is re- 
quired is that an indi-. 
vidual demonstrate speci- 
fied knowledge and skills 
at a.given time, in a pre- ° 
scribed context. Thus, 

measures of attainment 

possess only concurrent 

validity. 


Attainment, being concur- 
rent,.is cast in the past- 
perfect tense, e.g. an 


individual has demonstrated 


-effective written and i ‘ 
oral communication, a vari- . 
ety of problem-solving. : 
skills, the ability to . , 
create an artistic ren- > 


‘ factors such as judgment in determining warranted procedures and the 


intern's ability to engender a patient's, trust and confidence. 


The certification of competence necessarily includes the direct 
assessment of behavior in the cognitive, psychomotor and affective domains 
vii le attainment assesses tne cognitive and psychomotor domains only. 


~ /, 


The principal reason for the direct assessment of the- “affective dimen$ io 


ee of skills across a Maietsror aivlhaiesits ~ In fact, 


variety occupational and ee. Examples of aff ctive cons tracts 
6f competence are ego-strength, energy, order, self-confidence, maturity , 
diligence, judgment ,- assertiveness, Cc mpeti tiveness , sensitivity, human 
caring and empathy. However, the current level of Igophisti cation of psycho- 
metric devices to scanue these attributes (e.g... “the Minnesota Huletpnasys 
“Personality Inventory; Rorschachits* Tét, the Thematic Kepereepeten Test, 
‘Omnibus ’ ‘Personality Inventory, the analysis of bibliographical success and ' 
failure’ incidences, etc.) does not seem to warrant their use in the cer- 
tiftcation of competence. Perhaps, with further research and developnent, * 
measures-will be perfected which’ can be used .for such a purpose. 

The time over which skills are lobserved is-also an important aspect in 
the assessment of daiipe WnGeL tine’, by itself, does not insure competence | 
but it does allow an opportuni ty iy assessors to observe the replication | 
of a skill across a variety of situations, bse establishing greater proba- 


bility that the behavior will be Sustained beyond the certification proced- / 


.ures. Seemingly, the degree of confidence that an individual has mastered 


an] 


the essential skills and is able to integrate and apply them:to appropriate 
situations would be limited without sufficient time in which’ to observe 
them. | 


Examples of techniques which are appropriate for the holistic assess- 


ment of competence include the use of supervisor or peer ratings, to assess 


human. relations skills; oral, written, or objectives tests, to demons trate 


Know ledge mastery ; the systematic recording of success and failure incidences, 
to demonstrate eopabi lity for accurate self-assessment; written and oral de- 


SERIpELONS of decision- -making processes, to assess critical thinking and 


problen-solving capabilities; diaries which ec0rd critical incidences , to 


assess judgment ; or portfolios of work products over a period of time, to 
assess the capacity for sustained professional performance Thus assessment 
procedures in the certification of compe¥ence, necessarily include direct > 
professional review within occupational or\societal: poles, measures of 


behavior in the cognitive, psychomotor, and affective domains , and obser- 


‘vations over a sufficient time period to ensure reliability of performance. 


_ Attainment, on the other hand, is eErulyiga on the basis of Successful 


performances, OVENEP directly, before a faculty jury (whose composition in- 


cludes a practicing professional), or indirectly, in the form of individu@ly - 


adatnitstered testing procedures sanctioned by a jury. Performances take 
place in academic settingsand typically consist of oral examinations, demon- 


strations, Simulations, written essays, objectively scored tests, portfolios , 


or medi a-based performances. Secondly, affective aspects inherent in the 


demonstration of attainment are regafded as an implicit aspect of certifi- - 


able behavior. That is, with attainment, an individual would never be , 


poe — eee ance Anne ere ea - 


certified to have possessed an attitude of value. If a particular affec- 


tive state is deemed necessary for the desonstration of a specific skt11, 
it can be inferred to exist when the’ required behavior (ski11 or know- 
ledge) is adequately performed. Thirdly,.the assessment of attainment, 
as in competence, emphasizes comprehensiveness of performance indicdtors. 
Rarely does the certification of attainment involve fewer than three 
different performance measures in order to reliably assess the full 

range of cognitive and psychomotor hierarchies inherent in attainment. 


Unlike competence, minimum performance standards are established for 


“the. certification of attainment and are derived from two Pnenpay sources: 


current standards maintained in conventional educational programs , ane 
minimum entry level skills required for employment or for subsequent 


graduate cabin A ‘discrepancy analysis” 


is conducted comparing per- — 
formance Teves of graduates From existing educational programs to typical 
performance levels required for entry into related jobs or graduate pro- 
grams. Practicing professionals or lay consultants provide faculty with 
estimations of avaricisney levels required of job seeking graduates, while 


graduate faculty, members fulfill the same function in estimating levels of 


ire performance expected of students entering graduate pregnane: If there are * 


significant differences in thi .des ired performances for graduates and per- 


' formance requirements for entry to jobs or professional schools, the 


~ faculty of the baccalaureate educational programs are charged with the 


- 


responsibility for reconciling these differences. 
More than ae 


performance level may be recognized.in the demonstration 
of attainment. In addition to the minimum acceptable level of performance, 
one to several higher levels of achievement may be acknowledged depending 


on the degree to which faculty wish to differentiate among them. By 


ey, 


drawing distinctions among levels of’ acceptable performance, respect for 

truly outstanding scholarly cetraveiert is maintained which offsets the 

potential risk of degredation of standards to a common “level of medio- 
oeiy: a \common allegation of, gutcone-oriented educational prayranise 

Since the appraisal of comprehensive behaviors comprising attainment often 

involves a high degree of subjectivity, ratings of student performances: 

are “determined by consensual agreement among the members of a faculty jury. 


A jury of at least three faculty members jis desirable ay eer 4 


attainment in order to offset individual bias. However the size’ of the 
; ar can be reduced after a consistency among raters is established. 6 
Students are allowed multiple opportunities to demonstrate the mini- 
mum standard and failures are not recorded, since only the successful: 
performance is certified. In keeping with the niption' of "outstanding", 
only one opportunity is allowed for a student to demonstrate a perfor- 
mance above the minimum. Students who do not demonstrate the minfmum are 
ee advised of their strengths and weaknesses and are welchmed’ to try again 
when they believe the deficiencies have been removed. | 
Assessment tasks: and criteria used to certify attainments are stated : 
explicitly and publicly. It i's common knowledge that grading standards 
in post secondary education have undefgone serious inflation in the past 
decade such that the credibility of thei baccalaureate degree has come 
under public eeruttny: By awarding degrees based on attainment, a means 
is provided which both students and the public know exactly the kinds of 
knowledge skills and standards are required of graduates. In this way, 
an important step is taken toward restoring declining standards and ree: 
gaining public trust in the baccalaureate certificate. 


‘e Performances used to certify attainment are both process and content 


Lu 


* 
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oriented, In typical jury reviews , students are required to demonstrate 
mastery of the content of a discipline as well as proficiency in the 

application of cognitive processes. Examples of cognitive processes 
| evaluated in the demonstration of attainment include effective copmuni - 
cation, problem solving, critical thinking, hypotheses testing, and 
critical appreciation. Both of these aspects may be observed through. 
comprehensive performances such, as having students conduct a scientific’ 
experiment, produce-a creative work of art, or propose a strategy for a 
constructive human intervention. Thus, the most important aspects mm. 
assessing attainment are: the recording, of successful performances only, 
inpideit assessment of affective eimnonente af attainment, comrahineite: 
“ness of assessment ee and multiplicity of measures sampling both cogni- 
tive. and psychomotor domains, explicitness of performance tasks and criteria, 


and the observation: of the processes and products of’ good scholarship. 


The Ultimate Responsibility for Performahce Criteria: 
Who is the Guardian? 

Criteria for competence in professional roles are established and 
maintained outside the eucational enterprise, often’ in the form of licensing 
boards. -Guardianship of criteria for attainment, rests with the faculty of an 
educational fiatitutign: but with active collaboration of sieeuinay practit- 
ioners., Performance criteria for competence are derived systematically 
from job task analysis piobedupad and results in the identification of . 
essential skills and knowledge. Professional licensing boards or accredit- 
ing agencies may evaluate educational programs and assessment procedures to 


determine whether graduates possess minimal qualification for entry into the 


labor force, but the actual locus for the assessment of skills required for 
: 4 


Li 


the certification of competence occurs onzthesteb and after a predetermined 
amount. of experience has been accumulated. Consequently, a terminal -academtc. 
degree does ‘not imply, the possess ion of competence. .Educational ins'ti tutions 
provide only educational experiences which allow individuals to’master the 
knowledge and essential skills (attainments), required for entry into. a . 


—w 


profession. The attainments acquired in academe’are therefore the enabling 


skills which serve as the building blocks for eventual profesional competence. 


’ . : 


The- real work of professional licensing any certification procedures. is . 
are from ideal. Credentials or licenses, hich permit professional practice, 


are often issued on the basis of academic exposure (prescribed by. licensing 


' boards) and/or the achieving of minimum scores on normatively standardized 


s 


examinations, « Often, licensing examinations require only lower order, cognj- 
tive skills (e.g. recall or recognition) which have little, if any, nredi¢- 
tive Validity with respect to subsequent job performance. A recent review 

of current practices in certification of professional SEPRNENGE by ‘Mertges” 
indicates that a significant gap exists between the rigorous huitehedts 
for assessment and certification of-competence and the actual professional 
certification procedures in use today. Assessment criteria and standards 
for certification are often influenced by intu#tion’ and biases of state 


legislators interacting with power politics. Hence, the state of affairs 


in the certification of professional competence, based on validated job or 


occupational performance standards, may be viewed in its infancy (at best). 


The certification of Pomperence related to effective citizenship poses ° 
some extremely perplexing issues. Conceivably, ‘competence would be derived - 


from the identification of-characteristics of individuals who contribute to 


-the maintenance an progress. of, society. ~ Are-the characteristics of good 


t 
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. 


10.- 


e. 


are on welfare or incaracerated? Or 1s good eyehzenshyp represented by 

: those who hold jobs, voluntarily Honneibubede to conmunt ty service, ‘and 

attend to the needs of slits possess moral virtues, etc.? ‘Attributes 
of this latter. group are certainly not the exclusive province of baccalaur- ; 
eate educational RUOErENS Furthermore, what would be the composi tion of 


the authoritative body that would certify the possession of these charatteris- 7 
tics?” 


. Attainhent addrésses the issue of identifying and defending the desir- 
‘able characteristics of good aitizeneitn. by having the faculty formulate 
the desired outcomes ‘of ideation programs wit the advice of represen- $$ ™ 
tatives .of selected groups from outside academe ‘such as alumni, employers 
of stadente, lawmakers , the clergy; or the media. The important point of 
" emphasis is that the faculty of an educational institution is ultimately. | 
responsible for determining the nature of attainments which prepare Inds: s, ie 
viduals for effective citizenship. Since educational institutions are 
enayged with the responsibility of ° fostering the devélopment of basic 
knowledge and skills for good citizenship and for the enrichment of life, 
attainment appears to be a much more plausible basis upon which to certify 
learning outcomes related ‘to general or liberal education, 
% a e | 
Conclusion > j : | 
In closing, the. Following allegory demonstrates the re]ationship. be- 
. tween attainment ang competence: b ; 
There was once a iran ieateey who wished to 
teach students how to make an audience Taugh. tle, himself 
being highly SOMEbEDD: could induce an audience to'léugh : 


uncontrollably merely by holding up a green. feather in one ‘ 


he being able to hold the feathers correctly and smile salacious ly, an. s 


o 


hand and a red feather jn the other. ‘and smiling with @ 
 shéepish grin. However, often was the cage when he would 
hand the feathers to students to precipitate laughter as 

he did, audtences: would not only snub ‘the poor stidents 

but hiss and boo them’ as well no matter how hard they tried. 


In fact, ‘the harder sa@mfe*etudent tried the more intense be- 


- came ‘the boos and hisses. Finally, after much labor’ and er ; -_— 


coaching, students were eventually able to elicit :laughter 
‘by holding up a green and a red feather and sant Ting with a 
sheepish, lecherous grin. — 
-Anonymous- 
At the risk of extending a netaphor 08 far, a basic skill is analogous 
J 
attainment is making the audience laugh once, while competence is the 
ability to make varieties of audiences Taugh. under varied settings and eb 


ditions. The individual would: be ‘certified competent by having demonstrated 


“the criteria established by experts representing a professional accrediting 


agency such as Actors Equity. 


Bduee tonal institutions possess only limited capabilittes for. Reckaee 


human growth. They can provide opportunities for youth and adults to ‘develop 
certain skills, acquire knowledge, and perhaps adopt some desirable attitudes. 
With these modest expectations, institutions cannot be held “accountable. for 
‘engendering all skills, knowledge and attitudes rendtred for success, or for 


the way in which these are integrated and: applied in professional Bneeavors, 7 


or in life in general. ‘Attainment, the ‘educable enabler of Papen 


rather than competence itself, appears to be the more reasonable and lagiti- 


mate basis upon which degrees, ‘from “outcome-oriented éducational programs are 
* 7a 
awarded,” ees, Sx ; é Day 


‘pp. W2-b22. 
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